Papers with image processing
Meta Learning and Its Applications to Natural Language Processing (2021.acl-tutorials)
Copied to clipboard
| Challenge: | Meta-learning is a new technique that aims to learn better learning algorithms, including better parameter initialization, optimization strategy, network architecture, distance metrics, and beyond. |
| Approach: | This tutorial introduces Meta-learning approaches and the theory behind them, and then reviews the works of applying this technology to NLP problems. |
| Outcome: | This tutorial will introduce Meta-learning approaches and the theory behind them, and then review the works of applying this technology to NLP problems. |
Incorporating Image Matching Into Knowledge Acquisition for Event-Oriented Relation Recognition (C18-1)
Copied to clipboard
| Challenge: | Event relation recognition is a challenging language processing task because the query events are selected from different paragraphs in a document or even different documents, so there is lack of explicit clue. |
| Approach: | They propose to use image processing to acquire similar event instances and use image matching to approximate calculation between events. |
| Outcome: | The proposed model performs comparable to CNN while slightly better than LSTM on the ACE-R2 corpus. |
Effective Adversarial Regularization for Neural Machine Translation (P19-1)
Copied to clipboard
| Challenge: | Existing (small) perturbations that induce a critical prediction error in machine learning models are often referred to as adversarial examples. |
| Approach: | They propose to use adversarial perturbations to regularize text classification tasks by adding adversarials to a typical NMT model structure. |
| Outcome: | The proposed method significantly improves performance of NMT models, such as LSTM-based and Transformer-based models. |
HotelMatch-LLM: Joint Multi-Task Training of Small and Large Language Models for Efficient Multimodal Hotel Retrieval (2025.acl-long)
Copied to clipboard
| Challenge: | a novel multimodal dense retrieval model for the travel domain addresses limitations of traditional search engines. |
| Approach: | They propose a multimodal dense retrieval model that enables natural language property search . they propose combining a small language model and a large language model for embedding hotel data . |
| Outcome: | The proposed model outperforms state-of-the-art models on four diverse test sets . it is generalizable across LLM architectures and scalability for processing large image galleries . |
A Neural Few-Shot Text Classification Reality Check (2021.eacl-main)
Copied to clipboard
| Challenge: | Modern few-shot text classification models struggle when the amount of annotated data is scarce. |
| Approach: | They compare neural few-shot classification models with NLP and computer vision models with transformers to test their performance. |
| Outcome: | The proposed models perform almost equally on ARSC dataset, but not on the intent detection task. |
GAN-BERT: Generative Adversarial Learning for Robust Text Classification with a Bunch of Labeled Examples (2020.acl-main)
Copied to clipboard
| Challenge: | Recent Transformer-based architectures provide impressive results in many NLP tasks, but obtaining high-quality annotated data is expensive and time consuming. |
| Approach: | They propose a semisupervised learning method that ex- tends the fine-tuning of BERT-like architectures with unlabeled data in a generative adversarial setting. |
| Outcome: | The proposed method reduces the requirement for annotated examples while achieving good performance in sentence classification tasks. |
An Exploration of Three Lightly-supervised Representation Learning Approaches for Named Entity Classification (C18-1)
Copied to clipboard
| Challenge: | a recent study compares semi-supervised learning methods with bootstrapping methods . semi-semi-supervised methods reduce the amount of semantic drift introduced by iterative approaches . |
| Approach: | They propose to adapt three semi-supervised representation learning methods to an information extraction task . they show that all methods outperform state-of-the-art semi-representation learning methods . |
| Outcome: | The proposed methods outperform state-of-the-art semi-supervised methods on named entity classification task. |
Constructing a Public Meeting Corpus (2020.lrec-1)
Copied to clipboard
Koji Tanaka, Chenhui Chu, Haolin Ren, Benjamin Renoust, Yuta Nakashima, Noriko Takemura, Hajime Nagahara, Takao Fujikawa
| Challenge: | Existing corpora are created from text that has already been digitized. |
| Approach: | They propose a full pipeline of analysis of a large corpus about a century of public meeting in historical Australian news papers, from construction to visual exploration. |
| Outcome: | The proposed method achieves a high recall rate and an F-score of 87.8% on a historical Australian newspaper database. |
As easy as PIE: understanding when pruning causes language models to disagree (2025.findings-naacl)
Copied to clipboard
| Challenge: | Language Model pruning reduces the model's efficiency by removing weights, nodes, or other parts of its architecture. |
| Approach: | They propose to prune Language Models (LMs) to produce smaller, hence more efficient models with small loss to their effectiveness. |
| Outcome: | The proposed pruning method hurts data points that matter the most when pruning . the proposed pruning technique is based on a new study of NLP datasets . |
Compounding Geometric Operations for Knowledge Graph Completion (2023.acl-long)
Copied to clipboard
| Challenge: | Knowledge graph embedding (KGE) is one of the most fundamental problems in AI research. |
| Approach: | They propose a new knowledge graph embedding model by leveraging translation, rotation, and scaling operations to form a composite one. |
| Outcome: | The proposed model outperforms existing models on three KG prediction tasks. |
A Bird’s-eye View of Language Processing Projects at the Romanian Academy (L18-1)
Copied to clipboard
| Challenge: | a recent article outlines five projects that address contemporary Romanian language . the authors argue that a constant accumulation of human expertise is needed to develop complex projects. |
| Approach: | a new article gives a general overview of five AI language-related projects at the Romanian Academy . they focus on the creation of a contemporary Romanian language text and speech corpus and language related applications . |
| Outcome: | a new article gives an overview of five AI language-related projects at the Romanian Academy . the projects address contemporary Romanian language, as well as language related applications . |
Data Augmentation via Dependency Tree Morphing for Low-Resource Languages (D18-1)
Copied to clipboard
| Challenge: | Lack of sizable training datasets leads to poor performance in low-resource languages. |
| Approach: | They propose two techniques to augment training sets of low-resource languages using dependency trees. |
| Outcome: | The proposed methods improve on the training datasets for low-resource languages. |
Annotated Corpus of Scientific Conference’s Homepages for Information Extraction (L18-1)
Copied to clipboard
| Challenge: | a corpus of scientific conferences contains homepages with annotations of important information . name of conference, abbreviation, place, submission, notification, camera ready dates are included . |
| Approach: | They propose a corpus that contains 943 homepages of scientific conferences with annotations of interesting information. |
| Outcome: | The proposed corpus contains 943 homepages of scientific conferences, 14794 including subpages . the results show that it can be used as a reference data set for this type of task. |
Image and Text: Fighting the same Battle? Super Resolution Learning for Imbalanced Text Classification (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Using high-resolution images to overcome the problem of low resolution has never been used in NLP. |
| Approach: | They propose a super-resolution learning method that uses high-res images to overcome the problem of low resolution images. |
| Outcome: | The proposed method is efficient when compared to state-of-the-art methods on several benchmarks datasets in two languages. |
Performance Gap in Entity Knowledge Extraction Across Modalities in Vision Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Vision-language models excel at extracting and reasoning about information from images, yet their capacity to leverage internal knowledge about specific entities remains underexplored. |
| Approach: | They propose a dataset which allows separating entity recognition and question answering . they hypothesize that this decline arises from limitations in how information flows from image tokens to query tokens. |
| Outcome: | The proposed model performance drops when the entity is presented visually rather than textually. |